back down

verbs

move backwards from a certain position
"The bully had to back down"
is derived from
remove oneself from an obligation
"He bowed out when he heard how much work was involved"